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Overview  I 
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•  Overview  of  Special  Operations  Forces  (SOF) 
community 


•  Present  a  small  percentage  of  the  evidence 
accumulated  since  2004  for  these  questions: 

-  What  attitudes  do  SOF  operators  and  leaders  have  about 
language  testing? 

—  What  are  SOF  mission-related  language  requirements? 

•  Conclusion:  What  is  the  best  test(s)  for  SOF? 
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Overview  of  Testing  &  NA  History 
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Test 


Data  Collections 


Prior  to  2003 

2004 

Special  Operations  Forces  (SOF)  Language 

Needs  Assessment 

2005 

DIPT 

Defense  Language  Proficiency  Test 
Reading  and 

Non-participatory  Listening 

2006 

2007 

2008 

2009 

STANDARD  CHANGE 

Special  Operations  Forces  (SOF)  Language  and 
Culture  Needs  Assessment 

2010 

Naval  Special  Warfare  (NSW)  Training  Needs 
Assessment  (TNA) 

2011 

OPI 

2012 

Oral  Proficiency  Interview 
Speaking  or 

Air  Force  Special  Operations  (AFSOC)  TNA 

2013 

Speaking  and  Participatory 
Listening 

Special  Forces  (SF)  TNA;  Marine  Corps  Special 
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Current  USSOCOM  &  Service  FLPB  Policies 


•  DoD  Instruction  allows  for  the  Services  to  modify 
certain  requirements  to  qualify  for  the  bonus; 
therefore,  FLPB  policies  for  SOF  operators  vary  across 
SOF  Service  components 


-  USMC  pays  MARSOF  for  speaking  at  ILR  Level  1,  2,  and 
higher  DLPT  or  OPI 

-  DSN  pays  NAVSOF  for  speaking  at  ILR  Level  1  and  higher; 
pay  for  ILR  Level  2  and  higher  requires  DLPT5 

-  USA  pays  ARSOF  for  ILR  Level  1  (2  Skill  OPI  or  DLPT5)  and 
higher;  pay  for  ILR  Level  2  and  higher  requires  DLPT5 

-  USAF  pay  AFSOF  at  ILR  1/1  and  higher  in  any  two 
modalities 
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What  attitudes  do  SOF  operators  and  leaders  have  about  language 
testing? 


SOF-WIDE  ORGANIZATIONAL  NEEDS 
ASSESSMENTS 
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Organizational  Needs  Assessments 


•  Organization-level  Needs  Assessments 

•  2004  Language  Needs  Assessment 

•  2009  Language  and  Culture  Needs  Assessment 


•  Current  and  Desired  States  as  well  as  related  factors  that  influence  the  Gap 


Current  State  GAP  Desired  State 


Closing  the  Gap 

Use  Interpreters 
Change  Selection/Recruitment 
Change  Training 
Align  Testing  with  Other  Areas 
Increase  Incentives 
Decrease  Barriers 
Increase  Command  Support 
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2004:  Perceptions  of  Language  Need 
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•  Across  all  different  types  of  missions,  SOF  operators  reported  using 
speaking  and  iistening  skiiis  more  frequency  than  reading  and 
writing  skiiis. 

•  SOF  operators  and  leaders  disagreed  with  the  statement:  ''The 
content  of  the  DIPT  is  clearly  related  to  what  I  (our  operators)  do 
during  deployment." 

•  SOF  operators  and  leaders  agreed  with  the  statement:  ''The  OPI 
(Oral  Proficiency  Interview)  is  more  related  to  mission  performance 
than  the  DIPT" 

•  SOF  operators'  evaluations  of  DLPT's  relatedness  to  deployment 
tasks  were  related  to  evaluations  of  proficiency  pay's  fairness. 

Those  who  feit  that  the  DLPT  was  not  reiated  to  their  job  duties 
aiso  beiieved  FLPP  poiicies  to  be  unfair. 
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2009:  Perceptions  of  Language  Need 


•  Across  all  different  types  of  missions,  SOF  operators  reported  using 
speaking  and  iistening  skiiis  more  frequent iy  than  reading  and  writing 
skiiis, 

•  SOF  operators  and  leaders  disagreed  or  strongiy  disagreed  with  the 
statement:  "The  content  of  the  DIPT  is  clearly  related  to  what  I  (our 
operators)  do  during  deployment " 

•  SOF  operators  and  leaders  indicated  that  the  OPI  is  moderateiy  reiated  to 
very  reiated  to  job  requirements. 

•  SOF  operators  and  leaders  indicated  that  the  DIPT  was  not  reiated  or  only 
siightiy  reiated  to  what  SOF  operators  do  on  the  job 
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2009:  Perceptions  of  Language  Need 
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•  Time  spent  using  each  modality  on  inside  AOR  deployments 


Percent  Usage 


"The  purpose  of  language  for  all  soldiers  is  to  moke  them  capable  of  engaging  locals  to 
effectively  accomplish  the  mission.  Nothing  could  be  more  important  in  regards  to 
language  than  listening  and  speaking  skills." 

SOF  Leader,  5^^  SFG 
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standard  Change:  DIPT  OPI 
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•  Compared  to  the  DIPT,  the  OPI  was  considered: 

-  More  job-related 

-  More  related  to  deployment 

-  More  accurate  reflection  of  ability  to  use  language 

-  A  better  indicator  of  successful  use  of  language  on  missions 

-  A  more  accurate  reflection  of  ability  to  perform  in  the  target  language 


•  Neither  DIPT  nor  OPI  covered  all  tasks  required  on  deployment 
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standard  Change:  DIPT  OPI 


"It  is  practical  to  change  the  [testing]  format  to  a  listen  and  speaking.  This  is 
what  the  bulk  of  the  operators  will  engage  in  while  on  their  deployments." 

SOF  Leader,  Special  Forces  Group  (SFG) 


"it  [the  DLPT]  is  not  what  SOF  soldiers  need  to  be  effective  on  the  modern 
battlefield,  reading  and  writing  have  nothing  to  do  with  what  I  hove  done  on 
4  deployments" 

SOF  Operator,  5^*^  SFG 

"The  DLPT  accurately  measures  an  operators  overall  ability  in  a  given 
language  but  it  does  not  accurately  measure  the  operator's  ability  to  use  the 
language  to  accomplish  a  given  military  mission  down  range" 

SOF  Leader,  3^^  sFG 
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Summary  of  2004  and  2009  Findings 
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•  Speaking  and  listening  are  the  most  frequently  used 
modalities  for  deployed  SOF  operators 


•  SOF  operators  and  leaders  believe  the  OPI  is  more  job 
relevant  than  the  DIPT  for  SOF  operators.  But,  OPI  is  not 
viewed  as  the  perfect  assessment  by  SOF  operators 

•  There  is  a  lack  of  alignment  between  what  is  required  by  the 
mission,  what  is  tested,  and  what  is  incentivized 


*  Need  to  align  what  is  trained,  tested  and  compensated  with 
the  mission  requirements: 

—  Paying  for  the  DLPT  and  not  the  OPI  creates  completing  objectives, 
leads  to  maladaptive  behaviors  (e.g.,  teaching  to  the  test)  and 
undermines  mission  capability  and  readiness 
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What  are  SOF  mission-related  requirements? 


TRAINING  NEEDS  ASSESSMENTS: 
SUMMARY  OF  SOF  LANGUAGE 
NEEDS 
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TNA  Approach 


•  Need  to  align  systems  (training,  testing,  compensation,  etc.)  to 
provide  the  capability  needed  to  perform  organizational 
missions  and  accomplish  objectives  (Surface,  2012) 


•  Training  Needs  Assessment  (TNA) 

-  Uses  multiple  techniques  and  subject  matter  experts  (SMEs)  to  identify 
and  specify  training  requirements 

-  Training  requirements  will  guide  course  standards,  curriculum, 
materials  and  assessment  development 

-  TNA's  goal  is  to  align  capability  exiting  training  with  performance 
requirements 

-  Phases  of  TNA 

•  Mission/task  analysis:  Operational  SMEs 

•  Knowledge,  Skills,  Abilities,  and  Other  Characteristics  (KSAO) 
analysis:  Operational  and  language  SMEs 

•  Develop  training  requirements,  etc. 
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Example  Mission  Tasks 


•  NSW 

-  Conduct  full  spectrum  navigation  operations  (e.g.,  determine  actions  to  avoid 
collisions;  calculate  set  and  drift) 

•  AFSOC 

-  Provide  intra-theater  airlift 

-  Conduct  tactical  airlift 

-  Conduct  forward  arming  and  refueling  point  (FARP) 


•  SF 

-  Conduct  a  local  security  patrol 

-  Coordinate  medical  activity  support 

-  Key  leader  engagements 

-  Lead  a  raid 

-  Perform  tactical  combat  casualty  care  (TCCC) 
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Communicative  Modalities  Needed  by 
SOF  Operators 
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Participatory  speaking 


Participatory  listening 


Gestures 


Non-participatory  speaking 


Non-participatory  listening 


Reading 


Writing 


0% 


20% 


40% 


60% 


80%  100% 


■  SF 

■  AFSOC 
□  NSW 


Percentage  of  Mission  Tasks 
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Example:  SF  Mission  Tasks  that  Require 
Speaking  and  Listening  for  18A/18QA 
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•  Tasks  applying  to  military  occupational  specialties  (MOSs)  18A 
and  180A 

-  Build  rapport  to  promote  relationships  with  foreign  officers,  soldiers, 
and  civilians 

-  Conflict  management 

-  Convey  the  mission  planning  process 

-  Conversing  with  military  officials  (social  issues,  economics,  problems 
with  country,  drug  laws,  family,  politics,  religion  etc.) 

-  Key  Leader  Engagements 

-  Logistical  planning 

-  Training  partner  forces  how  to  make  basic  plans  (senior  level 
leadership) 

•  Can  do  analysis  by  job,  unit,  mission  or  other  organizing 
structure 
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Consistency  of  Evidence 


•  Although  we  have  presented  just  a  very  small 
percentage  of  the  evidence,  the  evidence  is 
very  consistent  across  SOF  components 


-  Participatory  Listening  and  Speaking  are  the  focal 
skills  for  the  communication  tasks  in  SOF 

-  They  are  needed  for  the  majority  of  the  mission 
and  job  tasks 

-  Other  modalities  are  used  but  not  to  the  extent 
and  importance;  others  can  vary  by  component, 
mission,  job  and  unit 
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Consulting 


LANGUAGE  TESTING  POLICY  NEEDS 
TO  ALIGN  WITH  MISSION 
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Assignment 


Testing 


Mission 

Requirements 


Training  incentives 
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Conclusion 
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•  Speaking  and  participatory  iistening  are  the  skills  most 
frequently  used  on  the  jobs  and  missions  in  SOF 

•  Need  to  ensure  that  training,  testing  and  compensation 
policies  are  aligned  to  produce  the  needed  mission 
capability— using  and  paying  for  proficiency  on  the 
appropriate  test  is  key  across  all  Services. 

•  Of  current  tests,  the  dual  modality  OPI  is  the  most  aligned 
with  SOF  needs;  All  four  Services  such  recognize  for  pay 

•  Developing,  using  and  paying  based  on  performance-  and 
capability-focused  assessments  would  improve  the  alignment 
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SWA  Consulting  Inc. 

311  S.  Harrington  Street 
Suite  200 
Raleigh,  NC  27603 

919.480.2751 

http://www.swa-consulting.com 
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